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When I taught Qiglish at Boston Trade High School, I 
dreaded days when I had to administer standardized tests. Normally 
cheerful students would become sullen, and normally sullen students 
would become belligerent. But one day, due to one test, I almost had 
• a real insurrection on my hands. 

The test day was a winter Monday. The building t^perature was 
edging toward 60. lliere was broken glass on the first floor of my 
home room, the result of weekend vandalism. I handed cut the tests, 
and my \vei Iders and cabinet makers reluctantly went to work. I glanced 
through the test and immediately spotted trouble. Half-way through, the 
students would have to explicate a poem that, it would seem, had been 
written by someone from the Hallmark Card Company. *'Go lovely 0 Rose" 
it began, 

\s I expected, when the leader of the w^ Iders reached "Go lovely 
0 Rose" he slammed his numbe r 2 pencil down and said "I quit J' Where- 
upon the rest of the wti Iders did the same thing whereupon the cabinet 
makers slammed their pencils down and stopped work. I made a half- 
hearted attenpt to jxplain why they should go on — something about the 
invaluable diagnostic information the test would provideH^ut there was 
no response. Finally I diu the only thing I could think of — I made 
it a group project and I helped. 

I'm not sure if what I did was a crime. If so the statute of 
limitations has expired and I can v-onfess. At the very least I fouled 
up some statistics. But what I retain from that Monday is not guilt but 
anger, anger that such an inappropriate test could be chosen fro my 
students. It has also cai sed me to look with a skeptical eye at standard- 
ized tests, so if the following examination of writing tests may seem 
unduly negative it is because I see unfair testing as a form of child abus 

Put yourself in the place of a student. You are to take a compe-* 
tency test that is to determine whether you repeat eighth grade. You 
joke with your friends beforri the bell, but you're scared. You walk 
Into the classroom and are handed the test, the first part of which 
asks you to write a report. The teacher reads the instructions: 
In the box below are some facts about the moon which you 



can use In your report. You may add other facts that 

you can remeiaber about the moon from your reading and 

classwork, from television, and from listening to people, 

# 

•••Be sure to report the facts in an order that will make 
sense to your classmates. 

Facts about the Moon 

Made of rock 
^ Mountainous, contains craters 

Covered with dust 
No air or water 
No plant or animal life 

Vou stare at th;£ list and try to remember what you know about the 
moon. Ilcver did like astronomy anyway. Some words flit through your 
head — Apollo, lurar, Armstrong — but you can't seem to fit them into 
a pattern. You connect Lhe facts into three chcppy sentences* and stop. 
Well, you think, I do have some friends ir seventh grade. 

I submit that tl is is not a far-fetched possibility. The "writing" 
test is not fabricated by me, but is one developed by the National Assess- 
mt^nt of Educational Progress (NAEP) , and, if the present trend continues, 
it will find its way into some state competency test of writing. Students, 
given no opportunity to choose their subjects or gather information, will 
be evaluated on their ability to write reports. 

I have recently OAamined ^ writing tests that are being constructed 
or used by states. To my mind most are seriously deiicient. I find 
equally disturbing the reluctance of individual states to develop their . 
own tests and their reliance on the NAEP or on private testmakers such 
as the Educational Testing Service. A hidden curriculum is being de- 
veloped by independent and semi-Independent organizations. V^ot only is 
it a hidden curriculum, but it is one that reflects some of the worst 
current practices in thi^ teacning of writing — triviality, In.'ide^iuaLe 
time allotment, a r nfused notion of "creative writing," and the poor cholc 
of writing topics. 

Triviality , According, to Gary Hart, author of the Califi)rnin Pupil 
Proficiency Bill, one of the purpo^;<iB of compeLeiicy testing; is to rusLore 
meaning to the high school diplopia and thus improve tlie public's attitude 
toward their schools •'^'•/This rationale Is echoed by most proponents of 
competency testing. Yi t many of the tests devised are either so sim- 
ple, or so marginal to the basic skills of writing, thai they would hardly 
meet mV* Hart's objective. 

Tennessee, for example, will assess competence in spelling *and grammar 



but not in writing. On one of the items devised for an early version 
of New York State Competency Tests, students ver,e asked to use '/will 
eat" in a sentence. According to the ruler for scoring, all students 
must do is to write the sentence with no mechanical errors. So presumably, 
"I will eat" would receive full credit. 

One of the proficiency tests that is generally taken as a model 
was developed by the Denver, Colorado school system. Students have to 
do no writing on these exams, but are given i^hat is called "Language 
Proficiency Exam" which requires the student to proofread 50 lines that 
"might have been written by a student."^ "Language Proficiency" 
becomes synonymous with "proofreading." Another proficiency test, pro- 
claimed by its developers as a success, is used in the Westlake,' Nebraska 
school System. The writing section requires the student to write three 
related paragraphs on a topic agreed on with the teacher and that the 
writing contain no more than five grammatical errors.^ 

Such attempts at measuring writing competency are inadequate, not 
because the mechanics of writing -are unimportant, but because "proficient** 
writing is more than "correct" writing. Imagine the student navigating 
his way through the three required paragraphs at West lake, aware that his 
primary task is to avoid errors. He may^ avoid syntactic errors by using 
short sentences; he avoids spelling errors by using s|.mple words or cir^ 
cumlocatio*ns ; he avoids contractions, and, in general, tries to be as 
timid and safe as possible. 

Such tests reinforce the negative image many Americans have .about 
writing. Donald Graves has described this attitude: 

In America, writing is basically a form etiquette 
in which words "^re put on paper, nut necessarily with 
clarity, but free of mechanical errors. The American 
extract does not belong in writing. He is similar to the person 

who hn's been reluctantly Invited to a party of distinguished 
guests. Being a person of modest station he attends with 
great discomfort. He has but one thing on his mind — to be 
properly attired, demonstrate the finest manners, say nothing, ^ 
and leave quickly ► ^ 



Inadeq ^ uate Ti me Allotmejit . Most of the tests thixt do require 
student writing limit the time allowed* 

Service t for example, is currently marketing a- t^t of basic ^skills 

which Includes in the writing section a number of multiple choice 

questions and a 20-minute writing sample on an assigned topic. The 

ETS claims, in its manuel for the test, that their exercises were 

developed "after a comprehensive review of the (relevant) research'* 
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and after consultation with professional organizations. 

The research that supports such a test was primarily conducted 

by the ETS itaeif; the most thorough study was reported by Godshalk, 

Swineford, and Coffman in 1966. In essence, the researchers gave a 

4 

large group of students impromptu essay tests on assigned topics and 

used the average score as the base against which they measured the 

effectiveness of their hour-long composition test* This test consisted 

of a number of multiple choice questions on sentence structure, some 

editing exercises, and a 20-minute essay on an assigned topic. They 

found that there was a high correlation between the average score on 

8 

the four essays and the bcores on the hour-long test. 

Yet despite the sophistication and scope of the Godshalk study, 
it fails to demonstrate the validity of the timed impromptu essay as a 
measure of writing competence. The researchers took as their defii tive 
measure of writing , ability scores on four impromptu essays. Nc^ver did 
the researchers look at writing done under looser time constraints where 
the student had suft^e cuuice of topic. The Godshalk study does not prove 
the val^Sity of Impormptu essay tests; it assumes their validity. 

^Recent researchr has raised questions about the use of the impromptu 
esgay, Sanders and Uttlefield found that the impromptu essay can fail 
toV^reveal the skills students have mastered, particularly if a course 
emphasizes thei writing process — pre-^wri ting, writing, revising^ editing. 
They uilequivocti I ly reject tlic use of the {mpronipLii essay as a nicasurc 
of writing competence: 

...the rigidly controlled essay test surely repr^^s(Jnts the 
extract ultimate in an artificial writing situation; as such it is 
shunned in many modern composition iX->urses. l^^lile the tc?Ht 
essay is precisely timed , in many courses the student is 
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encouraged to thlnkt research, write, rewrite, perhaps 

solicit advice and reactions, and rewrite again and 

again. The student has no chance to go through this 

9 

process in writing an impromptu essay. 

The 3fO-minute essay also sends a curious educational message. 

Research on the composing processes of good and poor secondary-school 

or college-freshmen writers is beginning to reveal consistent differ- 
10 

ences. The poorer writer generally spends little time pre-wrlting, 

writes in a burst, and then spends no time revising. Better writers 

spend far more time planning and pausing to reread what they have 

written. It is this time spent contemplating and planning that distin-- 

guishes the good from the poor writers. So what does the 20-minute 

essay .do? It forces the good writer to modify his composing process 

to put it more in line with that of the poor writers. Good writing 

habits must be discarded. Competency tests then require the more 

competent to imitate the less competent. 

As for the claim that the ETS has consulted national organisations, 

this seems unlikely in the case of the writing section. The most respected 

guide for the conduct of research, the NCTE monograph Research in Written 

Composition , argues that "twenty to thirty minutes seems ridiculously 

brief for ^a high school or college student to write anything thoughtful." 

The : athors recommend that high school students be given 70-90 minutes 

to write. ''^'^ John Mellon^ a researcher assigned by the NCTE to evaluate 

the NAEP results, claims that a fair sample of a student *s work would 
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consist of 800-iOOO words drawn from four or five essays. 

At its root the issue is ethical and not purely experimont-al. And 
the ethical question is simple. If states are to assess the writing 
competence of students, are they not under the ethical obligation to 
allow them to write under the best possible conditions? If so, is not 
one of these conditions adequate time to plan, write, and revise? 
Creative Writing . One of the early criticisms of the NAEP exercises was 
their functional orientation. Unfortunately, the exercises developed to 
meet this objection illustrate the current confusion about "crecitive 
writing." Too often creative writing translates into fictional writing 
where students must imagine themselves in situations far removed from 



their own expariences. Creativity becomes fantas;ifci^T^ and 

frequently these fantastical creations are curiously iojpersonal. 

Stereotypical imitations of the fantasies students watch on TV, 

Another type of creative writing exercise is to ask students to 

"write what they feeX,J' an exercise in formlessness. Both types 

of writing are called for on some state tests. 

The following exercise, developed by the NAEP, was adopted by 

the Ohio Department of Education for its eighth grade writing test. 

The purpose of the exercise » according to the Ohio manual ^ was for 

the student to "demonstrate ability in writing to reveal personal 

feelings and ideas through free expression." 

Sometimes people write just for the fun of it. This 
is a chance for you to have fun writing. 

Pretend you are a pair of tennis shoes. You've done all 
kinds of things in all kinds of weather. Now you are 
picked up again by your owner. Tell what you, as a pair 
of tennis shoes, think about what Is going^to happen to 
you. Tell how you feel about your o\mer. 

Surely there are better ways to assess personal writing than this. 
Tw my mind, the most convincing expression of personal feeling came 
from a student who wrote "I don't know." The response was classified 
as "other." 

In another NAEP exercise students were shown a picture of five 
children playing on an overturned dory. The dory is on o dock which 
reaches out to a small inlet where sailboats are moored. The instruc- 
tions were: 

These kids are having fun jumping on the overturned boat . 
Imagine you are one of the children in the picture. Or 
if you wish, imagine you are someone standing nearby watching 
the children. Tell what is going on as he or she would 
tell it. Write as if you are telling this to a good friend, 
in a way that expresses ^^rong feelings. Help your friend 
leel the experience too. 

Such an exercise violates the most basic rules for writing nssignmentf. 
In the first place, the children in the picture seem to be about eight 
years ola and few 13 or 17 year-olds (who were given the test by the NAEP) 
would enjoy .writing about children so much younger than they are. And 



although I distrust the automatic criticise} of socia*-economic bias* It 
does seexQ likely that the setting would be unf^ialliar to students who 
have spent no time at seaside or lakeside resorts. 

But the biggest problem with the assignment is that it invites a 
sophisticated phoniness. The following piece was given a top rating 
by the NA£F judges who determined that it ^demonst rates an ^'imaginative 
entry into experience:*' 

/ Jumping and running on the boat's ver^* enjoyable. Up we jump 
and down we float. X feel as if I could sail the boat around 
the world and back. The salty air blows through my nostrils. 
My body Is engulfed in this salty concoction. The wind beats 
against my cheeks. 

The white glistening enamel underside of the boat feels like 
silk (?) to the touch. The trees are aJive, pulsating, k'?iching 
our childish games. 

I feel like I could play forever. No concept of time, no 
stresses encourage my exhuberance* 

My body ^epara-ted from my spirit. 1 am no longer encaged in 
a prison of bones and skin* There are no barri^^s now. I can 
•O do whatever I want, when ever I want. (age 17) 

I sense a skilled writer performing an awkward task. The writer has been 
pushed into a difficult, and I believe dishonest stance by a topic that 
on one hand asks for artrong personal writing and on the other takes 
the writer away from that which he or she feels strongly about. 

Finally, some exercises give so little guidance that it is diffi- 
cult to see how the writing could be evaluated, Washington state has used 
tne following exercise in its eighth grade writing test: 

Music does different things to different people . Perhnps 

it makes you feel one way or another. Perhaps it reminds you 

of some place or something happening. 

Now listen to this piece nf music and write what things this 
piece of music de>es to you. Start writing any time you wish. 

Would a student taking this test have any idea of what is expected? 
Po or Topi cs . Writing mUst be about son.ethiiig. It is not some set of 
skills that can be assessed apart from the act of communication about a 
subject. The greates t and most consisten t weakni ^ss of the NAEP w riting 
exercises is their failure to ask students to write on subjects they know 
something about . The exercises move the student into areas where his 
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knowledge is severely liiaited. He often finds himself in* some hypo- 
thetical territory where he must he "creativi^," or he is iushed into 
what Don Graves has called ^'extended territory", writing ^bou«: national 
and international events and personalities. When the stuc|ent must write 
about this extended territory, without a chance to do research, he often 
writes wi^h limited information. A typical exercise: / 

Everyone knows of something that is worth talking about. 

Maybe you know something about a famous builciing like the 

/ 

Empire State Building in New York City or Something like 
the Golden Gate Bridge in San Francisco, pr you might know 

it 

extract a lot about the Mormon Tabernacle in Salt^Lake City or the 
new sports stadiums in Atlanta or St. L«^is. Or you may 
be familiar with something from naturelike Niagra Falls, 
a gigantic wheat field, a grove of or^^ge trees, or a part 
of a wic?2 muddy river like the Mlssif^sippi. Choose some- 
thing you know about. It may be something you have seen 
while traveling or something you Wave studied in school. 
Jhink about it for a while and tlien write a description 
of what it looks like so that it could be recognized 
by someone who read your description.'^^ 
Wliile ostensibly this is an open assignment, the implication is 
that the student should write about something "Important," something 
famous, and not something as insignificant as the student *s home or 
school ox favorite park. The writing that such exercises elicit in- 
variably deals with extended territory and illustrates the difficulty 
students have. The following piece was written for a similar NAEP 
assignment which required students to write on a person they admired. 
As might be expected, the possibilities suggested were all (malcO 
national or international flj^ures — Mickey Mantle, Winston Churchill, 
Martin Luther King, Jr. This piece was rated in the 87th percentile 
of the work done by 17-year-olds: 

Dr. Christian Bernard: I believe he is a person worth 
looking up to. He has tried to make our life longer for us 
through research about operations on heart trni splants. 
His determination to help mankind is recognized even though 
public opinion is very much against the practice of trans- 



f erring one person's heart to another person. This, deter- 
mination shows how a true doctor or any kind of scientist 
would work for the betterment of mankind, both for a longer 
^ life and an easier world to live in. Dr* Bernard shows the 
dedication of a true doctor, to^ielp man when he is sick or 
extract dying, as are many of the people on whoiA he operates • His 

determination makes him try to show the world that the heart 
is not a sacred organ of the body,*' and is just like any other 
part of the body when it needs to be repaired. His determination 

to find a better inethod, new drugs .to help after surgery is 

18 

to be admired. This is one of the reasons I admire him. 
I find this writing dismal, what Ken Macrorie has called "Engfish." 

The student has nothing specific to say about Dr. Bernard and must resort 

to abstractions and platitudes. 

The most confusintJ NAEP topic asks the student to write a letter 

of application. The exercise shows a notice of a job opening in a 

clothing store and gives the following directions: 

Chris Jones lives at 3600 Larch Street in New York, 
New York 10004. Chris has finished the junior year 

extract at high school and has been looking for a summer job. 

Chris spotted the advertisement in the New York Times 
and decided to apply for the job. Write Chris* letter 
to Mr. Fried. 

The student is put in a curious position. He is to write Chris* letter 
although he know/, nothing about Chris except his address and year in 
school. What is even more puzzling is the NAEP's method for evaluating 
the letter. To be awarded the higher marks the letter must include 
references, a statement of qualifications, and a way to be contacted, 
l^hixe these are -valid criteria for a letter of application, the instructions 
do not make clear the necessity^of the student Inventing such infornation. . 

The fact thac most states are looking for minimal competencies 
does not lessen the need for good topics. WIilmi a student must write 
withc^ut information, not only does content, suffer, but everything else 
suffers. A student cannot develop a paragraph if he has nothing to put 
into it. A student wlxl have trouble with transitions if be has no 

.11 
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information to transit from and to. He will have trouble maintaining 

a thesis on a topic he cares little about. Unfortunately, the NAEP 

topics have failed to motivate extensive writing. In the second round * 

writing assessment*, for example, the average length of writing for 17- 

year-olds ;was 137 words, with a sizable minority writing only one 
20 

paragraph. I would question any conclusions, even on writing sischanics, 

\^ 

that might be drawn from such obviously unmotivatted writing. 

Motivation wil^l become an increasingly serious problem if states ' 
and local districts move toward the primary trait scoring system dev^ 
eloped m conniFcfiiNij^ Briefly, primary trait scoring is an alternative to 
holistic scoring where general qualities such as organisation. Ideas, 
and style are evaluated in different types of writing. Rather it is 
argued that each type of writing has specific traits and therefore the 
criteric. for evaluation should chiinge as the writing task changes. 
Primary trait scoriftg, then, is more that a system of evaluation; it 
involves the construction of writing tasks in such a narrow way that 
specific skills or primary traits can be evaluated. 

Richard Lloyd-fJones, a proponent of primary trait scorings acknow- 
ledges that narrowly defined writing tasks may fail to motivate students, 
but he offers .no solutions: 

• The mor^ one restricts the situation in ord^r to define a 
purpose and' stimulate performance of a particular kind, 
extract the greater the chances that the exercise will fall outside 

of the respondents* experiences^ The testmaker must deal 
with the problem directly •'^'^ 



The testmaker facets rojTlicting pressures. He must develop a test that 
truly tests writing — 

he must develop a valid test. And he must develop a test that will be 
evaluated consistently by raters — he must develop a reliable test. As 
I see it these goals cannot be reconciled; they can only be balanced. 
Primary trait scoring creates an ^imbalance with its preoccu^tion with 
reliability. Unless a student is motivated to produce his bust work, 
of what value is a precise evaluation instrument? Is precise evaluation 
so important that students-should be given nc cnolce.in topics? The 
British, for example, in their writing tests ^;iven to students not going 
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on to college, may give as many as 10 options, sacrificing reliability on 
the chance that the student will find a topic that works • A balance 
must be struck, and the nature of this balance is a matter of human 
judgment and not some immutable psuchomevric law. 4^ 

Those who advocate the primary trait system are, in reality, advo- 
cating a return to the skills model, to a view of writing as a set of 
discrete skills that can be tested by exercises (I think it is signifi- 
cant that the NAEP calls them "exercises"). This model has been under 
steady, and to my mind, successful attack by teachers and rhetoricians. 
James Kinneavy, in his influei^^ial Theory of Discourse , writes: 

Sounds, morphemes, syntactic patterns, meanings of all 
kinds, skills in speaking, and the other arts of discourse, 
extract narration and the other modes of discourse — all these 

exist so that humans may achieve certain purposes in their 

22 

use of language with each other. 
The NAEP makes superficial attempts to prescribe aims ("Write in a way 
that expresses strong feelings") but these exhortations can only be in- 
effectual — like ordering your heart to double its beat. These aren't 
alms but pseudo-^aims. The paradox of using the NAEP exercises to measure 
writing competence is that a student *s capacity^ for meaningful com- 
munlcation Is evaluated on tlje basis" of a mean'lngless piece of writing — 
writing \i^lth no real purpose, no real audience. 

Any writing competency test must begin with a definition, l^fhat is 

"writing." I would argue that the tightly specific exercises that the 

•test 

NAEP is using do noty^writing because the assignments themselves make 

decisions that the writer should make. Decisions about purpose, content, 

point of view, focus, and language, are at the heart of the writing process 

— they are the writing process. Assignments that "present" the student 

with a subject,^a role, with information, with an organization are calling 

for a lobotomized activity. 

I use the term "lobotomized" in a literal sense The great Russian 

psychologist Alexander Luria studied many cases of frontal brain damage 

and has observed that a person so injured, loses the capacity to fortti 

lasting intentions, to plan for the future, or determine the course of 
23 

behavior. Nevertheless, when presented with a delimited task such as 
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a standard test of intelligence, the patient can perform quite 
well on it. Is it not possible that we are defining writing , 
competency is such a way that someone with frontal brain damage 
might be proclaimed competent? Is it not possible that such delimited 
exercises do not measure that capacity which, according to Luria, 
make us truly human, the capacity to form and carry out intentions? 
And is not this intentionality at the heart of what we call the 
writing process? 

I spent one morning going through a set of NAEP exercises. The 
more I read, the more depressed I became. There^seemed to be something 
limiting in setting any task and then devising|criteria that would apply 
to all the writing produced. I began to feel like 1 was in an airless 
room. 

I would wander to the kitchen to fix coffee and listen to my 
nine-month-old daughter make "b" sounds ~ "bbbbbbBBBBBB," she would 
increase volume and smile. I came back to ny str^v, to minimal 
competencies and primary trait scoring, i ^luctantly. I began to read 
some student work and came to a piece that dispelled the gloom, not 
because it was superbly written, but because there was in It a sense 
of delight and humor that made it stand out like a flower pushing through 
a sidewalk crack. It was written in response to one of the more inter-- 
esting NAEP topics: 

Imagine you are taking care of a neighbor's child for an 
afternoon. You send one of the children to the corner 
store to buy some peaches for a snack. 

The store owner, Mr. Jones, whom you have known and ^liked 
extract for several years, apparently took advantage of the child. 

The peaches are rotten. You want to send the child back 
with the peaches and a note to clear up the situation. 
Write a note to the grocer that expresses your displeasure 

24 

and proposes what Mr. Jones should do about the situation. 
After exercises requiring the writing of phone messages and letters 
of request, here we finally had something — melodrama. The followinc: 
piece clearly baffled the evaluators who classified it as ''generally 
factual) " and "not personally abusive''. I like to think of the writer 
.as someone who, as an infant, delighted in maKing sounds: 

• 14 
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Dear Mr. Jones: 

I am writing you In regaVd to the peaches that were .pur- 
chased by a child 1 was keeping. I -.anted some peaches 
for a snack but as I bit into one I found to my horror 
an^ disgust that they were rotten. Fortunately I kept 
cool. I tried so hard to forgive and forget, but the 
child 1 was keeping obviously couldn't. After eating 
12 of you rotten peaches she regurgitated all over the 
carpet but I tried to endure it because I had a brainstorm. 
I could feed the remaining peaches to the dog. But as 
luck would have It upon eating the peaches the dog^s 
hair fell out. However, Mr. Jones, even though these 
terrible things happened to me 1 am not mad. I am 
merely writing to tell you I realized something about 
you and extend ycu all my sympathy. Because after this 
event I now realize why you have no teeth or hair, because 
you've eaten your own rotten peaches. 

^ Your friend, 

Lee Smith 
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